Pandas Profiling Report

Dataset statistics

Number of variables	23
Number of observations	165086
Missing cells	649526
Missing cells (%)	17.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	69.9 MiB
Average record size in memory	443.8 B

Variable types

NUM	15
CAT	6
DATE	2

Reproduction

Analysis started	2021-05-20 18:42:36.925810
Analysis finished	2021-05-20 18:43:54.684433
Duration	1 minute and 17.76 seconds
Version	pandas-profiling v2.7.1
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

`RES_ADDR_CITY` has a high cardinality: 1067 distinct values	High cardinality
`original_matur_years` is highly correlated with `years_to_matur`	High correlation
`years_to_matur` is highly correlated with `original_matur_years`	High correlation
`age_loan_years` is highly correlated with `id`	High correlation
`id` is highly correlated with `age_loan_years`	High correlation
`RES_ADDR_CITY` has 58952 (35.7%) missing values	Missing
`EDUCATION` has 105340 (63.8%) missing values	Missing
`NUMBER_OF_FAMILY_MEMBERS` has 46504 (28.2%) missing values	Missing
`RESIDENTAL_STATUS` has 112400 (68.1%) missing values	Missing
`MARITAL_STATUS` has 87541 (53.0%) missing values	Missing
`FIXED_MONTHLY_EXPENSES` has 46504 (28.2%) missing values	Missing
`Flat_House` has 60334 (36.5%) missing values	Missing
`OPEN_DATE` has 38943 (23.6%) missing values	Missing
`INCOME_houshold` has 46504 (28.2%) missing values	Missing
`dpd` has 46504 (28.2%) missing values	Missing
`prepaid_amount` is highly skewed (γ1 = 21.41890118)	Skewed
`dpd` is highly skewed (γ1 = 37.57574973)	Skewed
`planned_installments` has 2742 (1.7%) zeros	Zeros
`prepaid_amount` has 145535 (88.2%) zeros	Zeros
`NUMBER_OF_FAMILY_MEMBERS` has 61233 (37.1%) zeros	Zeros
`FIXED_MONTHLY_EXPENSES` has 83787 (50.8%) zeros	Zeros
`INCOME_houshold` has 75819 (45.9%) zeros	Zeros
`dpd` has 105057 (63.6%) zeros	Zeros

date
Date

Distinct count	50
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.3 MiB

Minimum	2016-01-31 00:00:00
Maximum	2020-02-29 00:00:00

Histogram

Histogram

date_str
Real number (ℝ_≥0)

Distinct count	50
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	20173678.835915826
Minimum	20160131
Maximum	20200229
Zeros	0
Zeros (%)	0.0%
Memory size	1.3 MiB

Quantile statistics

Minimum	20160131
5-th percentile	20160331
Q1	20161130
median	20170831
Q3	20180831
95-th percentile	20191031
Maximum	20200229
Range	40098
Interquartile range (IQR)	19701

Descriptive statistics

Standard deviation	11124.96164
Coefficient of variation (CV)	0.0005514592421
Kurtosis	-0.919425036
Mean	20173678.84
Median Absolute Deviation (MAD)	9900
Skewness	0.3972513461
Sum	3.330391944e+12
Variance	123764771.5

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
20161130	4264	2.6%
20161031	4264	2.6%
20161231	4263	2.6%
20170131	4250	2.6%
20160930	4234	2.6%
20170228	4225	2.6%
20170331	4219	2.6%
20160831	4219	2.6%
20170430	4198	2.5%
20160731	4186	2.5%
Other values (40)	122764	74.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
20160131	3887	2.4%
20160229	3949	2.4%
20160331	3993	2.4%
20160430	4046	2.5%
20160531	4102	2.5%

Value	Count	Frequency (%)
20200229	1552	0.9%
20200131	1636	1.0%
20191231	1696	1.0%
20191130	1778	1.1%
20191031	1864	1.1%

id
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	5336
Unique (%)	3.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2351.100723259392
Minimum	1
Maximum	5355
Zeros	0
Zeros (%)	0.0%
Memory size	1.3 MiB

Quantile statistics

Minimum	1
5-th percentile	217
Q1	1108
median	2230
Q3	3551
95-th percentile	4742
Maximum	5355
Range	5354
Interquartile range (IQR)	2443

Descriptive statistics

Standard deviation	1448.041013
Coefficient of variation (CV)	0.6158991822
Kurtosis	-1.094258939
Mean	2351.100723
Median Absolute Deviation (MAD)	1213
Skewness	0.1877568478
Sum	388133814
Variance	2096822.775

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
846	50	< 0.1%
1868	50	< 0.1%
3407	50	< 0.1%
2033	50	< 0.1%
2850	50	< 0.1%
2126	50	< 0.1%
2466	50	< 0.1%
1649	50	< 0.1%
394	50	< 0.1%
2382	50	< 0.1%
Other values (5326)	164586	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	41	< 0.1%
2	36	< 0.1%
3	22	< 0.1%
4	39	< 0.1%
5	35	< 0.1%

Value	Count	Frequency (%)
5355	11	< 0.1%
5354	11	< 0.1%
5353	11	< 0.1%
5352	10	< 0.1%
5351	11	< 0.1%

years_to_matur
Real number (ℝ)

HIGH CORRELATION

Distinct count	3218
Unique (%)	1.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	9.61764032080249
Minimum	-0.1
Maximum	36.97
Zeros	5
Zeros (%)	< 0.1%
Memory size	1.3 MiB

Quantile statistics

Minimum	-0.1
5-th percentile	1.17
Q1	3.08
median	6.88
Q3	14.86
95-th percentile	25.04
Maximum	36.97
Range	37.07
Interquartile range (IQR)	11.78

Descriptive statistics

Standard deviation	7.987546896
Coefficient of variation (CV)	0.8305100451
Kurtosis	-0.3379568931
Mean	9.617640321
Median Absolute Deviation (MAD)	4.47
Skewness	0.9012519735
Sum	1587737.77
Variance	63.80090542

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2.25	371	0.2%
1.92	365	0.2%
2.67	359	0.2%
1.67	359	0.2%
2.92	340	0.2%
2.42	332	0.2%
1.75	325	0.2%
2.5	324	0.2%
2	323	0.2%
2.75	319	0.2%
Other values (3208)	161669	97.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-0.1	1	< 0.1%
-0.03	1	< 0.1%
-0.02	1	< 0.1%
0	5	< 0.1%
0.01	3	< 0.1%

Value	Count	Frequency (%)
36.97	1	< 0.1%
36.88	1	< 0.1%
36.8	1	< 0.1%
36.72	1	< 0.1%
36.63	1	< 0.1%

age_owner_years
Real number (ℝ_≥0)

Distinct count	4721
Unique (%)	2.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	47.2771499703185
Minimum	21.73
Maximum	75.98
Zeros	0
Zeros (%)	0.0%
Memory size	1.3 MiB

Quantile statistics

Minimum	21.73
5-th percentile	33.74
Q1	42.58
median	49.34
Q3	50.76
95-th percentile	59.97
Maximum	75.98
Range	54.25
Interquartile range (IQR)	8.18

Descriptive statistics

Standard deviation	7.431970013
Coefficient of variation (CV)	0.1572000431
Kurtosis	0.5404310987
Mean	47.27714997
Median Absolute Deviation (MAD)	2.12
Skewness	-0.187770892
Sum	7804795.58
Variance	55.23417827

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
50.76	2587	1.6%
50.67	2567	1.6%
50.59	2549	1.5%
50.51	2534	1.5%
50.42	2512	1.5%
50.34	2489	1.5%
50.26	2467	1.5%
50.18	2434	1.5%
50.09	2392	1.4%
50.01	2349	1.4%
Other values (4711)	140206	84.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
21.73	1	< 0.1%
21.81	1	< 0.1%
21.89	1	< 0.1%
21.98	1	< 0.1%
22.06	1	< 0.1%

Value	Count	Frequency (%)
75.98	1	< 0.1%
75.89	1	< 0.1%
75.81	1	< 0.1%
75.73	1	< 0.1%
75.64	1	< 0.1%

original_matur_years
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	1448
Unique (%)	0.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	14.336914335558438
Minimum	2.46
Maximum	41.99
Zeros	0
Zeros (%)	0.0%
Memory size	1.3 MiB

Quantile statistics

Minimum	2.46
5-th percentile	3.76
Q1	5.04
median	10.28
Q3	20.57
95-th percentile	30.9
Maximum	41.99
Range	39.53
Interquartile range (IQR)	15.53

Descriptive statistics

Standard deviation	9.334075932
Coefficient of variation (CV)	0.6510519428
Kurtosis	-0.7759673448
Mean	14.33691434
Median Absolute Deviation (MAD)	5.29
Skewness	0.6538165744
Sum	2366823.84
Variance	87.12497351

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
5.01	5022	3.0%
5.04	4474	2.7%
10.01	3901	2.4%
5.02	3878	2.3%
5	3859	2.3%
4.99	3721	2.3%
4.98	3502	2.1%
10.04	3380	2.0%
5.03	2889	1.7%
9.99	2599	1.6%
Other values (1438)	127861	77.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2.46	26	< 0.1%
2.72	16	< 0.1%
2.9	12	< 0.1%
2.96	595	0.4%
2.97	371	0.2%

Value	Count	Frequency (%)
41.99	50	< 0.1%
41.96	25	< 0.1%
41.41	38	< 0.1%
40.61	45	< 0.1%
40.5	29	< 0.1%

client_rate
Real number (ℝ_≥0)

Distinct count	495
Unique (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.04750170638333959
Minimum	0.0206
Maximum	0.098
Zeros	0
Zeros (%)	0.0%
Memory size	1.3 MiB

Quantile statistics

Minimum	0.0206
5-th percentile	0.0263
Q1	0.0334
median	0.043
Q3	0.0579
95-th percentile	0.0829
Maximum	0.098
Range	0.0774
Interquartile range (IQR)	0.0245

Descriptive statistics

Standard deviation	0.01767478402
Coefficient of variation (CV)	0.3720873494
Kurtosis	0.5266817117
Mean	0.04750170638
Median Absolute Deviation (MAD)	0.0119
Skewness	0.9385831883
Sum	7841.8667
Variance	0.0003123979902

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0.0579	12670	7.7%
0.068	5443	3.3%
0.0529	4487	2.7%
0.073	3278	2.0%
0.0429	3138	1.9%
0.053	3012	1.8%
0.0389	2966	1.8%
0.098	2823	1.7%
0.0279	2474	1.5%
0.0479	2269	1.4%
Other values (485)	122526	74.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.0206	100	0.1%
0.0207	220	0.1%
0.0208	250	0.2%
0.021	47	< 0.1%
0.0211	93	0.1%

Value	Count	Frequency (%)
0.098	2823	1.7%
0.0979	1462	0.9%
0.0978	82	< 0.1%
0.0977	73	< 0.1%
0.0974	51	< 0.1%

original_volume
Real number (ℝ_≥0)

Distinct count	2152
Unique (%)	1.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	172699.54929830512
Minimum	570.35
Maximum	3060751.59
Zeros	0
Zeros (%)	0.0%
Memory size	1.3 MiB

Quantile statistics

Minimum	570.35
5-th percentile	15140.2
Q1	55686.9
median	122236.38
Q3	225029
95-th percentile	518500
Maximum	3060751.59
Range	3060181.24
Interquartile range (IQR)	169342.1

Descriptive statistics

Standard deviation	178797.8389
Coefficient of variation (CV)	1.035311555
Kurtosis	26.25599215
Mean	172699.5493
Median Absolute Deviation (MAD)	76799.12
Skewness	3.376015079
Sum	2.85102778e+10
Variance	3.196866721e+10

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
103700	7327	4.4%
207400	4461	2.7%
155550	4347	2.6%
51850	4019	2.4%
82960	3215	1.9%
72590	3202	1.9%
124440	3138	1.9%
62220	2616	1.6%
41480	2408	1.5%
259250	2329	1.4%
Other values (2142)	128024	77.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
570.35	2	< 0.1%
1037	33	< 0.1%
1921.98	6	< 0.1%
2696.2	35	< 0.1%
3422.1	2	< 0.1%

Value	Count	Frequency (%)
3060751.59	37	< 0.1%
2074000	50	< 0.1%
1742160	35	< 0.1%
1659200	34	< 0.1%
1555500	53	< 0.1%

age_loan_years
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	1578
Unique (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4.719292913996342
Minimum	0.0
Maximum	17.58
Zeros	63
Zeros (%)	< 0.1%
Memory size	1.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0.56
Q1	2.23
median	4.29
Q3	6.94
95-th percentile	10.01
Maximum	17.58
Range	17.58
Interquartile range (IQR)	4.71

Descriptive statistics

Standard deviation	3.019929133
Coefficient of variation (CV)	0.639911357
Kurtosis	-0.4249606393
Mean	4.719292914
Median Absolute Deviation (MAD)	2.3
Skewness	0.5059218032
Sum	779089.19
Variance	9.119971967

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
2.42	345	0.2%
2.67	338	0.2%
2.59	338	0.2%
2.25	327	0.2%
1.84	312	0.2%
2.84	310	0.2%
1.92	309	0.2%
2.5	307	0.2%
2.35	303	0.2%
1.67	302	0.2%
Other values (1568)	161895	98.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	63	< 0.1%
0.01	81	< 0.1%
0.02	119	0.1%
0.03	90	0.1%
0.04	105	0.1%

Value	Count	Frequency (%)
17.58	1	< 0.1%
17.5	1	< 0.1%
17.41	1	< 0.1%
17.33	1	< 0.1%
17.25	1	< 0.1%

outstanding_volume
Real number (ℝ_≥0)

Distinct count	161526
Unique (%)	97.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	102313.25092878864
Minimum	0.0
Maximum	1785948.22
Zeros	55
Zeros (%)	< 0.1%
Memory size	1.3 MiB

Quantile statistics

Minimum	0
5-th percentile	5298.575
Q1	24665.95
median	63312.17
Q3	137070.3225
95-th percentile	330735.78
Maximum	1785948.22
Range	1785948.22
Interquartile range (IQR)	112404.3725

Descriptive statistics

Standard deviation	120477.5616
Coefficient of variation (CV)	1.177536248
Kurtosis	21.06754504
Mean	102313.2509
Median Absolute Deviation (MAD)	46492
Skewness	3.293259992
Sum	1.689048534e+10
Variance	1.451484285e+10

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
103700	103	0.1%
207400	90	0.1%
155550	81	< 0.1%
72590	57	< 0.1%
0	55	< 0.1%
1037	38	< 0.1%
186660	38	< 0.1%
82960	34	< 0.1%
259250	34	< 0.1%
165920	34	< 0.1%
Other values (161516)	164522	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	55	< 0.1%
0.01	2	< 0.1%
0.02	2	< 0.1%
0.03	2	< 0.1%
0.04	1	< 0.1%

Value	Count	Frequency (%)
1785948.22	1	< 0.1%
1781907.83	1	< 0.1%
1777677.25	1	< 0.1%
1773611.29	1	< 0.1%
1769390.49	1	< 0.1%

planned_installments
Real number (ℝ_≥0)

ZEROS

Distinct count	98231
Unique (%)	59.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	836.7942237379303
Minimum	0.0
Maximum	19384.34
Zeros	2742
Zeros (%)	1.7%
Memory size	1.3 MiB

Quantile statistics

Minimum	0
5-th percentile	108.7425
Q1	313.92
median	570.55
Q3	1009.65
95-th percentile	2402.365
Maximum	19384.34
Range	19384.34
Interquartile range (IQR)	695.73

Descriptive statistics

Standard deviation	980.9166328
Coefficient of variation (CV)	1.172231601
Kurtosis	47.54744744
Mean	836.7942237
Median Absolute Deviation (MAD)	307.72
Skewness	5.135721265
Sum	138143011.2
Variance	962197.4405

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	2742	1.7%
864.16	474	0.3%
1296.25	154	0.1%
432.08	80	< 0.1%
518.5	75	< 0.1%
432.09	74	< 0.1%
950.59	58	< 0.1%
430.83	52	< 0.1%
1728.34	50	< 0.1%
549.92	49	< 0.1%
Other values (98221)	161278	97.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2742	1.7%
0.01	11	< 0.1%
0.02	1	< 0.1%
0.04	3	< 0.1%
0.39	1	< 0.1%

Value	Count	Frequency (%)
19384.34	1	< 0.1%
19360.05	1	< 0.1%
18568.69	1	< 0.1%
18562.81	1	< 0.1%
18318.02	1	< 0.1%

prepaid_amount
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct count	7523
Unique (%)	4.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1800.0924453920986
Minimum	0.0
Maximum	1101604.46
Zeros	145535
Zeros (%)	88.2%
Memory size	1.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	5401.6125
Maximum	1101604.46
Range	1101604.46
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	13730.30929
Coefficient of variation (CV)	7.627557864
Kurtosis	798.9204637
Mean	1800.092445
Median Absolute Deviation (MAD)	0
Skewness	21.41890118
Sum	297170061.4
Variance	188521393.2

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	145535	88.2%
10370	961	0.6%
1037	884	0.5%
5185	800	0.5%
2074	711	0.4%
518.5	578	0.4%
20740	527	0.3%
3111	461	0.3%
4148	337	0.2%
1555.5	304	0.2%
Other values (7513)	13988	8.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	145535	88.2%
0.44	1	< 0.1%
1.04	1	< 0.1%
2.43	1	< 0.1%
3.62	1	< 0.1%

Value	Count	Frequency (%)
1101604.46	1	< 0.1%
839454.77	1	< 0.1%
773640	1	< 0.1%
647170.91	1	< 0.1%
595463.71	1	< 0.1%

type
Categorical

Distinct count	3
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.3 MiB

cl_fix	78545
mtg_fix	76755
mtg_grn_fix	9786

Value	Count	Frequency (%)
cl_fix	78545	47.6%
mtg_fix	76755	46.5%
mtg_grn_fix	9786	5.9%

Length

Max length	11
Mean length	6.761330458
Min length	6

Value	Count	Frequency (%)
Lowercase_Letter	10	90.9%
Connector_Punctuation	1	9.1%

Value	Count	Frequency (%)
Latin	10	90.9%
Common	1	9.1%

Value	Count	Frequency (%)
ASCII	11	100.0%

RES_ADDR_CITY
Categorical

HIGH CARDINALITY
MISSING

Distinct count	1067
Unique (%)	1.0%
Missing	58952
Missing (%)	35.7%
Memory size	1.3 MiB

WARSZAWA	6896
KRAKÓW	4043
WROCŁAW	2267
KATOWICE	2222
TYCHY	1731
Other values (1062)	88975

Value	Count	Frequency (%)
WARSZAWA	6896	4.2%
KRAKÓW	4043	2.4%
WROCŁAW	2267	1.4%
KATOWICE	2222	1.3%
TYCHY	1731	1.0%
ŁÓDŹ	1676	1.0%
SZCZECIN	1671	1.0%
BIELSKO-BIAŁA	1617	1.0%
GLIWICE	1559	0.9%
CZĘSTOCHOWA	1538	0.9%
Other values (1057)	80914	49.0%
(Missing)	58952	35.7%

Length

Max length	26
Mean length	6.477236107
Min length	3

Value	Count	Frequency (%)
Uppercase_Letter	33	47.8%
Lowercase_Letter	30	43.5%
Other_Punctuation	4	5.8%
Space_Separator	1	1.4%
Dash_Punctuation	1	1.4%

Value	Count	Frequency (%)
Latin	63	91.3%
Common	6	8.7%

Value	Count	Frequency (%)
ASCII	52	75.4%
Latin Ext A	15	21.7%
Latin 1 Sup	2	2.9%

EDUCATION
Categorical

MISSING

Distinct count	7
Unique (%)	< 0.1%
Missing	105340
Missing (%)	63.8%
Memory size	1.3 MiB

H	29466
S	14894
D	7044
R	3990
L	2142
Other values (2)	2210

Value	Count	Frequency (%)
H	29466	17.8%
S	14894	9.0%
D	7044	4.3%
R	3990	2.4%
L	2142	1.3%
N	1796	1.1%
P	414	0.3%
(Missing)	105340	63.8%

Length

Max length	3
Mean length	2.276183323
Min length	1

Value	Count	Frequency (%)
Uppercase_Letter	7	77.8%
Lowercase_Letter	2	22.2%

Value	Count	Frequency (%)
Latin	9	100.0%

Value	Count	Frequency (%)
ASCII	9	100.0%

NUMBER_OF_FAMILY_MEMBERS
Real number (ℝ_≥0)

MISSING
ZEROS

Distinct count	9
Unique (%)	< 0.1%
Missing	46504
Missing (%)	28.2%
Infinite	0
Infinite (%)	0.0%

Mean	1.206481590797929
Minimum	0.0
Maximum	50.0
Zeros	61233
Zeros (%)	37.1%
Memory size	1.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	2
95-th percentile	4
Maximum	50
Range	50
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.951938738
Coefficient of variation (CV)	1.617876934
Kurtosis	271.245782
Mean	1.206481591
Median Absolute Deviation (MAD)	0
Skewness	11.32695359
Sum	143067
Variance	3.810064835

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	61233	37.1%
2	19107	11.6%
1	14389	8.7%
3	11475	7.0%
4	10129	6.1%
5	1833	1.1%
6	228	0.1%
8	105	0.1%
50	83	0.1%
(Missing)	46504	28.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	61233	37.1%
1	14389	8.7%
2	19107	11.6%
3	11475	7.0%
4	10129	6.1%

Value	Count	Frequency (%)
50	83	0.1%
8	105	0.1%
6	228	0.1%
5	1833	1.1%
4	10129	6.1%

RESIDENTAL_STATUS
Categorical

MISSING

Distinct count	9
Unique (%)	< 0.1%
Missing	112400
Missing (%)	68.1%
Memory size	1.3 MiB

home owner	16242
owner of another apartment	13761
home owner / owner of cooperative house	9727
live with parents	5258
other	2296
Other values (4)	5402

Value	Count	Frequency (%)
home owner	16242	9.8%
owner of another apartment	13761	8.3%
home owner / owner of cooperative house	9727	5.9%
live with parents	5258	3.2%
other	2296	1.4%
none	1898	1.1%
najemca prywatne	1531	0.9%
private tenant	1032	0.6%
tenant municipal cooperative company	941	0.6%
(Missing)	112400	68.1%

Length

Max length	39
Mean length	8.589686588
Min length	3

Value	Count	Frequency (%)
Lowercase_Letter	19	90.5%
Space_Separator	1	4.8%
Other_Punctuation	1	4.8%

Value	Count	Frequency (%)
Latin	19	90.5%
Common	2	9.5%

Value	Count	Frequency (%)
ASCII	21	100.0%

MARITAL_STATUS
Categorical

MISSING

Distinct count	6
Unique (%)	< 0.1%
Missing	87541
Missing (%)	53.0%
Memory size	1.3 MiB

M	57594
S	13470
D	5035
W	746
I	541

Value	Count	Frequency (%)
M	57594	34.9%
S	13470	8.2%
D	5035	3.0%
W	746	0.5%
I	541	0.3%
P	159	0.1%
(Missing)	87541	53.0%

Length

Max length	3
Mean length	2.060550259
Min length	1

Value	Count	Frequency (%)
Uppercase_Letter	6	75.0%
Lowercase_Letter	2	25.0%

Value	Count	Frequency (%)
Latin	8	100.0%

Value	Count	Frequency (%)
ASCII	8	100.0%

FIXED_MONTHLY_EXPENSES
Real number (ℝ_≥0)

MISSING
ZEROS

Distinct count	144
Unique (%)	0.1%
Missing	46504
Missing (%)	28.2%
Infinite	0
Infinite (%)	0.0%

Mean	339.5313243999933
Minimum	0.0
Maximum	11700.0
Zeros	83787
Zeros (%)	50.8%
Memory size	1.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	390
95-th percentile	1755
Maximum	11700
Range	11700
Interquartile range (IQR)	390

Descriptive statistics

Standard deviation	755.4855576
Coefficient of variation (CV)	2.225083529
Kurtosis	31.71659
Mean	339.5313244
Median Absolute Deviation (MAD)	0
Skewness	4.193772584
Sum	40262303.51
Variance	570758.4277

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	83787	50.8%
650	4575	2.8%
1300	3601	2.2%
390	2636	1.6%
780	2197	1.3%
130	1729	1.0%
1040	1719	1.0%
260	1671	1.0%
1950	1423	0.9%
2600	1404	0.9%
Other values (134)	13840	8.4%
(Missing)	46504	28.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	83787	50.8%
13	11	< 0.1%
26	44	< 0.1%
65	661	0.4%
78	91	0.1%

Value	Count	Frequency (%)
11700	34	< 0.1%
7800	96	0.1%
6760	23	< 0.1%
6500	124	0.1%
5443.88	28	< 0.1%

Flat_House
Categorical

MISSING

Distinct count	2
Unique (%)	< 0.1%
Missing	60334
Missing (%)	36.5%
Memory size	1.3 MiB

H	64228
F	40524

Value	Count	Frequency (%)
H	64228	38.9%
F	40524	24.5%
(Missing)	60334	36.5%

Length

Max length	3
Mean length	1.730940237
Min length	1

Value	Count	Frequency (%)
Uppercase_Letter	2	50.0%
Lowercase_Letter	2	50.0%

Value	Count	Frequency (%)
Latin	4	100.0%

Value	Count	Frequency (%)
ASCII	4	100.0%

OPEN_DATE
Date

MISSING

Distinct count	2049
Unique (%)	1.6%
Missing	38943
Missing (%)	23.6%
Memory size	1.3 MiB

Minimum	1991-08-01 00:00:00
Maximum	2021-04-10 00:00:00

Histogram

Histogram

INCOME_houshold
Real number (ℝ)

MISSING
ZEROS

Distinct count	1234
Unique (%)	1.0%
Missing	46504
Missing (%)	28.2%
Infinite	0
Infinite (%)	0.0%

Mean	4805.0740982273865
Minimum	-28130.388
Maximum	335624.652
Zeros	75819
Zeros (%)	45.9%
Memory size	1.3 MiB

Quantile statistics

Minimum	-28130.388
5-th percentile	0
Q1	0
median	0
Q3	4953.384
95-th percentile	21909.912
Maximum	335624.652
Range	363755.04
Interquartile range (IQR)	4953.384

Descriptive statistics

Standard deviation	13132.45357
Coefficient of variation (CV)	2.733038721
Kurtosis	154.9152487
Mean	4805.074098
Median Absolute Deviation (MAD)	0
Skewness	8.900384591
Sum	569795296.7
Variance	172461336.8

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	75819	45.9%
3000	231	0.1%
7200	201	0.1%
6960	176	0.1%
3600	165	0.1%
2640	141	0.1%
8400	133	0.1%
2520	126	0.1%
3240	112	0.1%
4200	111	0.1%
Other values (1224)	41367	25.1%
(Missing)	46504	28.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-28130.388	41	< 0.1%
-3530.28	30	< 0.1%
-18.948	37	< 0.1%
0	75819	45.9%
720	12	< 0.1%

Value	Count	Frequency (%)
335624.652	39	< 0.1%
139273.416	32	< 0.1%
134381.7	66	< 0.1%
133655.664	74	< 0.1%
108072.012	8	< 0.1%

dpd
Real number (ℝ_≥0)

MISSING
SKEWED
ZEROS

Distinct count	178
Unique (%)	0.2%
Missing	46504
Missing (%)	28.2%
Infinite	0
Infinite (%)	0.0%

Mean	1.269990386399285
Minimum	0.0
Maximum	997.0
Zeros	105057
Zeros (%)	63.6%
Memory size	1.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	3
Maximum	997
Range	997
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	20.53734021
Coefficient of variation (CV)	16.17125643
Kurtosis	1524.30909
Mean	1.269990386
Median Absolute Deviation (MAD)	0
Skewness	37.57574973
Sum	150598
Variance	421.7823428

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	105057	63.6%
1	5012	3.0%
2	1683	1.0%
3	1291	0.8%
4	807	0.5%
5	660	0.4%
6	469	0.3%
7	323	0.2%
8	309	0.2%
10	280	0.2%
Other values (168)	2691	1.6%
(Missing)	46504	28.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	105057	63.6%
1	5012	3.0%
2	1683	1.0%
3	1291	0.8%
4	807	0.5%

Value	Count	Frequency (%)
997	2	< 0.1%
991	2	< 0.1%
990	1	< 0.1%
986	1	< 0.1%
978	3	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	date	date_str	id	years_to_matur	age_owner_years	original_matur_years	client_rate	original_volume	age_loan_years	outstanding_volume	planned_installments	type	RES_ADDR_CITY	EDUCATION	NUMBER_OF_FAMILY_MEMBERS	RESIDENTAL_STATUS	MARITAL_STATUS	FIXED_MONTHLY_EXPENSES	Flat_House	OPEN_DATE	dpd
0	2016-10-31	20161031	1	11.49	44.22	25.01	0.0342	51850.0	13.53	33397.66	196.04	mtg_fix	JELENIA GÓRA	S	4.0	owner of another apartment	M	1040.0	F	2016-10-31	0.0
1	2016-11-30	20161130	1	11.41	44.30	25.01	0.0342	51850.0	13.61	33201.62	202.84	mtg_fix	JELENIA GÓRA	S	4.0	owner of another apartment	M	1040.0	F	2016-10-31	5.0
2	2016-12-31	20161231	1	11.32	44.38	25.01	0.0342	51850.0	13.69	32998.78	197.21	mtg_fix	JELENIA GÓRA	S	4.0	owner of another apartment	M	1040.0	F	2016-10-31	0.0
3	2017-01-31	20170131	1	11.24	44.46	25.01	0.0342	51850.0	13.77	32801.57	201.43	mtg_fix	JELENIA GÓRA	S	4.0	owner of another apartment	M	1040.0	F	2016-10-31	0.0
4	2017-02-28	20170228	1	11.16	44.55	25.01	0.0342	51850.0	13.86	32600.15	198.97	mtg_fix	JELENIA GÓRA	S	4.0	owner of another apartment	M	1040.0	F	2016-10-31	0.0
5	2017-03-31	20170331	1	11.07	44.63	25.01	0.0342	51850.0	13.94	32401.18	202.53	mtg_fix	JELENIA GÓRA	S	4.0	owner of another apartment	M	1040.0	F	2016-10-31	0.0
6	2017-04-30	20170430	1	10.99	44.72	25.01	0.0342	51850.0	14.02	32198.65	199.62	mtg_fix	JELENIA GÓRA	S	4.0	owner of another apartment	M	1040.0	F	2016-10-31	0.0
7	2017-05-31	20170531	1	10.90	44.80	25.01	0.0342	51850.0	14.11	31999.03	200.19	mtg_fix	JELENIA GÓRA	S	4.0	owner of another apartment	M	1040.0	F	2016-10-31	0.0
8	2017-06-30	20170630	1	10.82	44.88	25.01	0.0342	51850.0	14.19	31798.84	203.75	mtg_fix	JELENIA GÓRA	S	4.0	owner of another apartment	M	1040.0	F	2016-10-31	0.0
9	2017-07-31	20170731	1	10.74	44.97	25.01	0.0342	51850.0	14.28	31595.09	201.39	mtg_fix	JELENIA GÓRA	S	4.0	owner of another apartment	M	1040.0	F	2016-10-31	0.0

Last rows

	date	date_str	id	years_to_matur	age_owner_years	original_matur_years	client_rate	original_volume	age_loan_years	outstanding_volume	planned_installments	prepaid_amount	type	RES_ADDR_CITY	EDUCATION	NUMBER_OF_FAMILY_MEMBERS	RESIDENTAL_STATUS	MARITAL_STATUS	Flat_House	OPEN_DATE	INCOME_houshold	dpd
165076	2016-12-31	20161231	4659	3.10	50.59	5.02	0.053	23442.56	1.92	13481.62	324.59	1158.51	cl_fix	GLIWICE	R	3.0	owner of another apartment	M	F	2000-12-23	14459.076	0.0
165077	2017-01-31	20170131	4659	3.02	50.67	5.02	0.053	23442.56	2.00	11998.52	299.83	1408.66	cl_fix	GLIWICE	R	3.0	owner of another apartment	M	F	2000-12-23	14459.076	0.0
165078	2017-02-28	20170228	4659	2.93	50.76	5.02	0.053	23442.56	2.09	10290.04	261.67	1451.80	cl_fix	GLIWICE	R	3.0	owner of another apartment	M	F	2000-12-23	14459.076	1.0
165079	2017-03-31	20170331	4659	2.85	50.84	5.02	0.053	23442.56	2.17	8576.57	223.50	1348.10	cl_fix	GLIWICE	R	3.0	owner of another apartment	M	F	2000-12-23	14459.076	0.0
165080	2017-04-30	20170430	4659	2.77	50.92	5.02	0.053	23442.56	2.25	7004.97	191.07	1266.18	cl_fix	GLIWICE	R	3.0	owner of another apartment	M	F	2000-12-23	14459.076	0.0
165081	2017-05-31	20170531	4659	2.68	51.01	5.02	0.053	23442.56	2.34	5547.72	154.43	1451.80	cl_fix	GLIWICE	R	3.0	owner of another apartment	M	F	2000-12-23	14459.076	0.0
165082	2017-06-30	20170630	4659	2.60	51.09	5.02	0.053	23442.56	2.42	3941.49	114.98	0.00	cl_fix	GLIWICE	R	3.0	owner of another apartment	M	F	2000-12-23	14459.076	1.0
165083	2017-07-31	20170731	4659	2.52	51.18	5.02	0.053	23442.56	2.51	3826.51	115.15	725.90	cl_fix	GLIWICE	R	3.0	owner of another apartment	M	F	2000-12-23	14459.076	2.0
165084	2017-08-31	20170831	4659	2.43	51.26	5.02	0.053	23442.56	2.59	2985.46	92.33	518.50	cl_fix	GLIWICE	R	3.0	owner of another apartment	M	F	2000-12-23	14459.076	0.0
165085	2017-09-30	20170930	4659	2.35	51.34	5.02	0.053	23442.56	2.67	2374.63	76.98	2297.65	cl_fix	GLIWICE	R	3.0	owner of another apartment	M	F	2000-12-23	14459.076	0.0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows